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A method of compression by blocks of digital data repre- 
senting physical quantities comprises a coding configuration 
step (E3) in which there is associated with each block of 
digital data a coding technique chosen from amongst a set 
(E) of acceptable coding techniques as a function of a 
criterion. 

The choice criterion is a function of optimization of the rate 
or distortion characterizing the coding configuration under 
the constraint of a given computational resource. 

Use notably in a transmission videophone system. 
26 Claims, 6 Drawing Sheets 
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METHOD AND DEVICE FOR technique coded from amongst the set of coding techniques 

COMPRESSION BY BLOCKS OF DIGITAL acceptable according to a criterion. 

DATA In accordance with the invention, this choice criterion is 

a function of optimisation of the rate or distortion charac- 

The present invention concerns a method of compression 5 terising the coding configuration under the constraint of a 

by blocks of digital data used notably in the field of the & iven computational resource. L . . 

compression of a still or moving digital image. T»* compression method according to the invention 

It also concerns a compression device adapted to imple- makes il P 055 ^ t0 choose a block codin S configuration 

ment the compression method according to the invention. best ^8 a computational resource, explicitly taking into 

The technical field of the invention is the compression, 10 account a compromise between the computational complex- 

with loss, of digital data representing physical quantities, il V and the performance in terms of rate/distortion of each 

and notably representing the pixel value for a digital image, available coding technique. 

for applications such as videotelephony on a transmission M a g eneral ^ lhe S rcater me computational resource, 

network in which real-time compression methods are used. the hi 8 her the rate/distortion performance. Thus, for a given 

The invention applies particularly to compression sys- 15 computation time resource, it is a case of best consuming it 
terns implemented by software, on an operating system b y maximising the rate/distortion performance, 
capable of making the computing resources visible. The Preferably, this compression method comprises a corn- 
operating system can form part notably of a generic host P utm S ste P for each block of digital data and for each coding 
computer, with shared resources limited notably with regard technique of an elementary consumed computational 
to computing resources. 20 resourc e by the coding technique expressed in time of 

A compression method is particularly considered in calculation, 

which the data to be compressed are first of all partitioned each codin g technique is characterised in terms of 

into a set of blocks, each of these blocks being coded by a consumed computational complexity, and no longer solely 

coding technique chosen amongst a finite set of acceptable m terms of rate and distortion. 

coding techniques. 25 Advantageously, the computational resource incorpo- 
Generally, coding techniques with loss are described on rates lhe computing time for obtaining said elementary 
the one hand in terms of distortion, a distortion which consumed computational resource and the consumed corn- 
becomes less and less corresponding to a finer and finer putational resource for resolving the optimisation function, 
approximation of the coded digital signal, and on the other ™us a computational resource constraint is used which 
hand in terms of rate, that is to say coding cost. 30 integrates both the resource consumed for obtaining elemen- 
In a conventional fashion, the different coding techniques tarv quantities but also the resource consumed by the 
applicable are chosen according to a rate/distortion compro- optimisation algorithm in order to know the computational 
mise. It is a case in particular of best minimising the resource actually available for achieving the compression of 
distortion under the constraint of an allocated rate or, tne digital data. 

conversely, best minimising the coding rate under the con- 35 According to different particularly practical embodi- 

straint of a given distortion, ments of the Nation, 

However, the complexity of the compression algorithms the optimisation function is adapted to minimise a rate 

used conventionally in the coding of digital data, and in associated with the coding configuration for a compu- 

particular during the coding of a video signal, is very great tational complexity less than a given computational 

and makes real-time compression of a digital signal with 40 resource; or 

reasonable resolution very difficult. the optimisation function is adapted to minimise a mean 

A technique making it possible to take into account this distortion associated with the coding configuration for 

concept of time was disclosed in the document published in a computational complexity less than a given compu- 

the context of the MPEG (Moving Picture Expert Group) tational resource; or 

standard entitled "Informative annex about the use and 45 the optimisation function is adapted to minimise an upper 

implementation of complexity estimation and CGD", by bound distortion associated with the coding configura- 

Marco Mattavelli and Sylvain Brunetton, Document ISO/ tion for a computational complexity less than a given 

IECJTC1/SC29NVG11/MPEG98/M3073, February 1998. computational resource. 

This technique, referred to as CGD (the acronym for According to another preferred characteristic of the 

"Computational Graceful Degradation") makes it possible to so invention, the compression method comprises a prior step of 

deliver, when a coded digital signal is compressed, a choosing a criterion amongst a function of optimisation of 

decoded signal of lesser quality when the required quality the rate or of the distortion characterising the coding con- 

cannot be obtained in real time with the computing resources figuration under the constraint of a given computational 

available on the operating system implementing the decod- resource, a function of optimisation of the rate characterising 

ing. 55 the coding configuration under the constraint of a given 

However, this technique only makes it possible to adapt distortion and a function of optimisation of the distortion 

the decoder to the calculation resources of the system, as a characterising the coding configuration under the constraint 

function mainly of the structure of the bit stream generated of a given rate. 

by the compression operation used, in this case a compres- The compression method thus advantageously makes it 

sion according to the MPEG4 standard. 60 possible to effect a normal optimisation of the rate/distortion 

The present invention on the other band relates to a performance (that is to say a minimisation of the distortion 

compression method which can adapt to the computing under the constraint of a given rate or a minimisation of a 

resources of the system implementing it. rate under the constraint of a given distortion) when no 

The present invention thus concerns a method of com- calculation time constraint is required for compressing the 

pression by blocks of digital data representing physical 65 digital signal. 

quantities, comprising a coding configuration step in which, In practice, the said set of acceptable coding techniques 

with each block of digital data, there is associated a coding comprises inter coding techniques, such as a predictive 
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coding by movement compensation, a coding by time pre- FIGS. 3 and 4 are algorithms detailing the coding con- 
diction or a coding by multilinear prediction, and intra figuration step of the compression method according to a 
coding techniques, such as a coding by spectral transforma- second embodiment of the invention; 
tion or a coding by vector quantisation. FIG. 5 is an algorithm illustrating a variant of FIG. 4 

The compression method according to the invention thus 5 according to a third embodiment of the invention; and 

makes it possible to choose, amongst conventional coding piG. 6 is a block diagram illustrating a computer adapted 

techniques, those which best meet the choice criterion. to implement the compression method according to the 

According to a preferred characteristic of the invention, invention 

which also makes it possible to improve the coding of a set A description wiU be given below of a method of com . 

of digital data, the compression method also comprises a 1Q ion fa bbcks - n accortiance with lhe invention Hed 

step of partitioning into blocks of digital data representing * ^ ^ signal, 

physical quantities, in which the partitioning of blocks is VT „ . ,. . , f 4 . , , 

a * a u ^ »u ♦ • * r Naturally, the digital data to be compressed can be any 

effected by a partitioning under the constraint of a given , J ' . , . . . . *\ , , . , 

computational resource. data ^presenting Physical quantities, and notably a digital 

Thus a partitioning of the digital data is effected which «™» stiU or movin g> m colour or black and white - 
makes it possible to best use the available computational 15 1q a video signal, each image I to be compressed corn- 
resources of the system implementing the compression. P nses mree components: a luminance component and two 

In practice, the present invention is particularly well chrominance components. In the compression diagram 

suited to a compression method comprising a step of parti- described below it is considered that the components are 

tioning into blocks of digital data representing a digital compressed sequentially and independently of each other, 

image or a digital video signal. 20 Only the compression of one of these components will be 

Correlatively, the present invention concerns a device for described below, 

compressing by blocks of digital data representing physical The method of compressing a digital image I comprises 

quantities, comprising coding configuration means adapted first of all, with reference to FIG. 1, step El of partitioning 

to associate, with each block of digital data, a coding each component to be compressed into a set of blocks, 

technique chosen from amongst a set of acceptable coding 25 Thus each component is divided into blocks of size pxp, 

techniques as a function of a criterion, the choice criterion typically 16x16 or 8x8. Naturally, these blocks could be 

being a function of optimisation of the rate or distortion other than square. 

characterising the coding configuration under the constraint For each component of size LxH, there exist 
of a given computational resource. 

This compression device has characteristics and ad van- 30 - L X H 

tages similar to those described previously for the compres- ~ p p 
sion method according to the invention. 

In practice, this compression device is incorporated in a ... , . , T , . . . . . 

microprocessor, a read only memory being adapted to store * oc ^ 10 be J ooded : In the ^amder of the description these 

a program of compression by blocks of digital data, and a 35 blocks are denoted a,, wth i=l, ... ,N 

random access memory comprising registers for storing In this embodiment of the mvenUon, and non-limitaUvely, 

variables modified during the running of said program. compression method comprises a prior step of choosing 

According to one advantageous characteristic of the a cntenon E2 as a function of which there will be chosen 

invention, the microprocessor is adapted to supply the value to \ each b ^ k a " a technique, denoted m y , with 

of a given computational resource at a given moment. 40 J- 1 - ■ ■ chosen from amon 6 st K acceptable coding 

The compression method implemented on this device can CC L ic l ues ; , . . . , , ™ 

thus advantageously choose a coding configuration by using ™ e ch ° lce of lhe cntenon made at . the posing step E2 

an optimisation function under a computational resource can be made amongst several optimisation funcUons such as: 

constraint determined by the microprocessor. rate optimisation functions, characterising each coding 

The present invention also concerns a computer, a digital 45 configuration {m 7 {a,-]} under the constraint of a given 

image processing apparatus, a digital printer, a digital pho- distortion, or 

tographic apparatus, a digital camera or a video telephony distortion optimisation functions, characterising each 

system on a transmission network comprising a compression coding configuration {m^aj} under the constraint of a 

device according to the invention. rate, or in accordance with the invention, 

It also relates to a computer program product, incorpo- 50 optimisation of the rate or distortion characterising each 

rated in fixed or removable fashion in a compression device, coding configuration {m ; {a ( ]} under the constraint of a 

comprising software code portions adapted to implement the given computational resource, 

compression method according to the invention. Amongst the coding techniques conventionally used in 

The advantages of this computer, digital image processing video signal compression schemes, there can be distin- 

apparatus, digital printer, digital photographic apparatus, 55 guished the coding techniques known as inter and the coding 

digital camera, video telephony system on a transmission techniques known as intra. 

network or computer program product are similar to those of For the record, in inter coding techniques, each block 

the compression method which they implement. under consideration is coded with reference to a block of a 

Other particularities and advantages of the invention will so-called reference image, and in intra coding techniques 

emerge from the following description. 60 each block under consideration is coded solely with refer- 
In the accompanying drawings, given by way of non- ence to the current image to which it belongs. 

limitative examples: Amongst the inter coding techniques, there is notably 

FIG. 1 is a general algorithm of the compression method predictive coding by movement compensation. 

applied to a digital image I according to the invention; Amongst the intra coding techniques, there are for 

FIG. 2 is an algorithm detailing the coding configuration 65 example coding by spectral transform of the digital signal 

step of the compression method according to a first embodi- (discrete cosine transform or discrete wavelet transform) and 

ment of the invention; coding by vector quantisation. 
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These coding techniques are used in Lhe standard com- simple way of estimating the complexity Cy for each coding 

pression schemes such as H.261 and H.263 of the ITU technique m ( ., is to effect an estimation by least squares on 

(International Telecommunication Union) and MPEG-1, measurements Q^n.Cy+Q, where Q is the measurement of 

MPEG-2 and MPEG-4 of the ISO (International Standards the calculation time, n, represents the number of calls on the 

Organisation) and do not require to be described in detail 5 coding technique under consideration for several values of n ( - 

here. and C a represents a residual offset value which is assumed 

These coding techniques can be distinguished, apart from to be constant. The estimated value is of course dependent 

their nature as mentioned above, also by a particular choice on the host machine, the operating system, the compiler and 

of coding parameters (for example a particular choice of the compiling options used for generating the executable 

quantisers for a transform coding). 10 program, but it can be produced once and for all during an 

Each coding technique m,- is characterised at the same initialisation phase, for example before the start of compres- 

time by rate, distortion and computational complexity quan- sion. 

tities. In this example embodiment it is considered that there is 

The rate, denoted r(m ; {aj), is expressed in bits and a set E of four acceptable coding techniques. The techniques 

measures the length of the output code representing the 15 cited below are well known in the state of the art and are 

block a f coded by the technique m y .. This rate comprises both described only briefly below. 

the length of an identifier of the technique m y - and the length The code identifying the coding technique can be coded 

of any parameters or data necessary for decoding. This rate in a fixed length in two bits, application of each of these 

value r(mJX]) can be determined in advance, being either techniques being considered equiprobable in principle, 

fixed in the case of a code with a fixed length or predicted 20 A first technique m 1 of the set E is an inter coding by time 

or estimated in the case of a variable-length coding as a prediction. In such a technique, the current block a,- of the 

function of a probability model. image at time t is considered to be the block corresponding 

For example, in the case of an arithmetic coding in which to the same spatial condition in the reference image, which 

the probability of appearance p of each coding symbol is can be the previous image at time (t-1), so that a^O-a^t-l). 

estimated adaptively, an estimation of the length of the code 25 This technique does not require the transmission of any 

can be given, by number of estimated bits, by the function parameter. This therefore gives r(m 1 [a,-])=r(m 1 )=2 bits. 

-log 2 (p) (referred to as self-information). It can in practice be found, for a normal computer and 

The resulting distortion, denoted d(a I , ££m.]), expresses compiler, that the computational complexity is proportional 

the distance d between the original block a,- and its approxi- to the number of pixels in the block, that is to say c(m 1 

mation a ( {m y ] obtained by means of the coding technique m,. 30 [a J ])=p 2 xc(m 1 ). This complexity corresponds to the calcu- 

A distance measurement normally used in image com- lation of the distortion, 

pression is the root mean square error. This is generally The proportionality factor cfmj is estimated by least 

calculated between the block a,- and the reconstructed block squares on a set of calculation time measurements obtained 

a ( {m y ], which requires consumption of computational for different block size values. 

resources. The value of the distortion can also be predicted 35 A second technique m 2 of the set E is an inter coding by 

by using for example a rate/distortion model adapted to the movement compensation. In such a technique, the current 

coding technique under consideration. block a,- of the image at time t is predicted in the direction 

Such rate/distortion models are described notably in the of the movement by a moved block of the reference image, 

work entitled "Vector quantization and signal compression", which can be the previous image at time (t-1). 

by A. Gersho and R. Gray, Kluwer Academic Publisher, 40 The movement of the block is estimated amongst a set of 

1992, for coding by vector quantisation. possible solutions (a set referred to as the search window) by 

Finally the complexity, denoted cfmfej), expresses the different techniques known to persons skilled in the art 

computational resource consumed by application of the which it is not necessary to detail here. These techniques 

technique m y to the block a,-. This computational resource require the transmission of the movement vector for decod- 

can be expressed as the machine time of the coding process. 45 ing. 

Other complexity measurements could also be considered, A fixed-length code is for example considered: for a 

taking into account the quantity and type of elementary search window of size (2w+l)x(2w+l), a code of length 

operations performed by the processor (CPU) of the log 2 (4w 2 -*-4w) rounded up to the integer value above, 

machine and the data communications necessary to the For example, w=2, a code of 5 bits is necessary and 

execution of the coding process. Modelling and complexity 50 consequently this gives r(m 2 [a I -])=r(m2)=2+5 bits, 

measuring means are given for example in the document It is, as before, found in practice that, for a normal 

published in the context of the MPEG (Moving Picture computer and compiler, the computational complexity is 

Expert Group) standard entitled "Informative annex about proportional to the number of pixels in the block, that is to 

the use and implementation of complexity estimation and say c(m 2 [a l -])"-p 2 xc(m 2 ). This complexity corresponds to the 

CGD", by Marco Mattavelli and Sylvain Brunetton, Docu- 55 calculation of the distortion during the search for the best 

ment ISO/IECJTC1/SC29WG11/MPEG98/M3073, Febru- movement vector. 

ary 1998, and in the document entitled "Predicting MPEG The proportionality factor c(m^) is estimated by least 

Execution Times" by Andy C. Bavier et al, Department of squares on a set of calculation time measurements obtained 

Computer Science, University of Arizona, Sigmetrics *98, for different block size values. 

proceedings page 131, June 98. 60 A third technique m 3 of the set E is an inter coding by 

It is generally verified that the computing time measured multilinear prediction as described in French patent appli- 

by means of system calls (corresponding, on an operating cation 97 08647 in the name of the Applicant. 

system of the UNIX type, to a CPU time complexity) This technique requires the transmission of four predic- 

various substantially linearly with the number of discrete tion coefficients and one offset value. This therefore gives 

operations performed by each coding technique. 65 r(m 3 [a l -])=r(m3)=2+13 bits. 

For coding techniques with "regular" complexity, that is It is also shown that, in practice, for a normal computer 

to say not depending on data of the block to be coded a ; , a and compiler, the computational complexity is proportional 
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to the number of pixels in the block, that is to say c(m 3 a mean distortion 
[a ( -]>p 2 xc(m3). 

The proportionality factor c(m 3 ) is estimated by least ^ 

squares on a set of calculation time measurements obtained °~it ^ a '^ mj ^ 

for different block size values. 5 

A fourth technique m 4 of the set E can be an intra coding 

by hierarchical table look-up vector quantisation (HTLVQ). or 

This technique is detailed for example in the article entitled an U ^ T 1x31111(1 ^ orUon 

"Constrained and Recursive Hierarchical Table Look-up ]0 D-sup, dfa^JmD 

Vector Quantization" by N. Chaddha, Proceedings of the ^ choice of Qne ^ Qlher of ^ dislortion measurements 

Data Compression Conference, April 1996. being di ctale d by considerations of a psycho-visual nature 

This technique requires the transmission of the quantisa- for an image or video signal or psycho -acoustic for an audio 

lion index indicating the vector best representing the block signal. 

to be coded of size pxp. The necessary rate depends on the 15 Thus, in this example where the digital data to be corn- 
cardinal of the quantisation dictionary used. If a dictionary pressed represent a video signal, it can be considered that an 
... j. . etc*- j j- • o u-* • a- • , upper bound distortion is best suited in that the human eye 
with a cardinal of 256 is used, coding in 8 bits is sufficient. • . - r i_* i_ j i i* j • 

43 is sensitive to variations of high magnitude localised in 

This therefore gives r(m 4 [aJ)-r(m 4 )=2+8 bits. space ^ ^ which h the case ^ the blocks of a video 

Here also, it is found that in practice, for a normal 20 image, 

computer and compiler, the computational complexity is Thus different optimisation functions can be used for 

proportional to the number of pixels in the block, that is to determining the coding configuration at step E3. 

say c(m 4 [a 1 .])-p 2 xc(m 4 ). This complexity corresponds The optimisation function can be adapted to minimise the 

„ v : mnt '\„ , rt iU* „„ m u^~p™ m ™ rate R associated with the coding configuration for a com- 

approximately to the number oi memory accesses necessary A . . . . _ . * * . . 

/ . , t putational complexity C lower than a given computational 

for cod.ng by HTLVQ. 25 resource, denoted C a : 

The proportionality factor c(m 4 ) is estimated by least 

squares on a set of calculation time measurements obtained N N 

for different block size values. min R = £ rv">h-]):C = £ c(m,-[a,-]) s c a 

In accordance with the invention, the choice criterion 
used for determining the coding configuration during a 

configuration step E3 is a function of optimisation of the rate The optimisation function can also be adapted to mini- 

or distortion characterising the coding configuration under mise . a mean distortion D associated with the coding con- 

the constraint of a given computational resource. figuration for a computational complexity C less than a 

„. i j . i - i * * j « given computational resource C* 

Since each coding technique m ; - is characterised as 35 & r a 

described previously in terms of computational complexity N N 

c(m y ) and at least in terms of rate or distortion, it is possible min D = £ d{a„ oi[m;]):C = £ c(m,[a ; )) s c a 

to use an optimisation function which makes it possible to m <-i 

best use the computational resources available on the system 

implementing the compression method. 40 FinaU {he optimisation ^ naion can ^ adapted to mini . 

At the end of this configuration step, there is a combina- mise an uppef bound ^onion D associated with the coding 

lion {mJ>J, i-l, . . . ,N} which is referred to as the coding configuration for a computational complexity C less than a 

configuration and which is optimum in the sense of the gj ven computational resource C a : 

chosen criterion calculated on all the blocks a, to be com- Ae " 

pressed. N 

Thus, assuming a distinct coding of each of the blocks and nrin D = suprffo, a, fm y ]): C = ^ cv*,[a;]) * c a 

sequential implantation of the compression method, the 1 M 
following can be noted: 

a rate R equal to the sum of the constituent rate values: so Since the constituent values characterising each accept- 
able coding technique of the set E are known, these opti- 

n misation functions are problems of discrete allocation which 

h = Yj 'WoiD can be resolved numerically by known methods, the sim- 

,=! plest but most complex in calculation time being the exhaus- 

55 live enumeration of all the possible configurations and the 

a complexity C equal to the sum of the constituent JJ* of the ^ 0ne in the 56056 of the Criterion consid * 

complexity values: h ^ Qoled ^ {he fifst twQ optimisalion factions 

mentioned above are equivalent to a problem of allocation of 

c = Y c(m [ai]) + c 0 60 a separable resource which can be resolved by a rapid 

£f J technique of convex programming well known in digital 

data compression and described for example, in the case of 
a rate-distortion optimisation, in the document entitled 

where C 0 represents an offset value integrating the data «j oull optimisation techniques in image and video coding 

input/outputs, the displays and any other processing 65 with applications to multiresolution digital broadcast", by K. 

of constant complexity independent of the coding Ramchandran, doctoral thesis at the University of Columbia, 

configuration, and June 1993. 
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By way of example, it is considered in the remainder of 
the description that the choice criterion corresponds here to * 
the aforementioned function of optimisation of the upper C = 4^ fol) 
value distortion under the constraint of an allocated com- 
putational resource C a , 5 

The computational resource constraint also incorporates and a boolean value BCaJ is initialised to "false" for every 
the calculation time C. for obtaining constituent consumed ^ ^ ^ ^ rf ^ values 
computational resources C 0 for resolving the optimisation fc thefl ryn lfar Q in ordef lQ optimise (0 th e (0 disto?tion and, 
function so that the computational resource actually avail- J0 at step E18j me correspond i n g oairs m /(0 [a (( J in the current 
able is C a '=C a -C e -C fl . coding configuration are modified by updating the con- 
Obviously, if Ca' is negative, compression is not possible. sumed complexity C=C+c(my ( Ja l - (0 ])--c(m ; {a l -]). The distor- 
It is therefore important to know in advance (that is to say tion is therefore reduced at the expense generally of an 
without consuming any computational resource), or to rap- increase in computational complexity, 
idly estimate the constituent quantities necessary for the is H?jwcw the ^technique associated with a block a, must be 
.... - . « r . • /• i modified only if the pair m^ m Ja,l in the list has already 
optumsauon function and to use a fast optim.sa.ion algo- ^ mQ ^ £ co ^ c ^ ( the defaull techniqu ; 

nlnm - ^cmiJi & i] necessarily results in lesser distortion for a lesser 

The resolution of the function of optimisation of the upper complexity. 

bound distortion will now be described in detail in a first This condition is satisfied by virtue of the test of step E16. 

embodiment of the invention illustrated in FIG, 2. 20 Use is made there of a boolean value previously initialised 

™_. i r i *■ r*i- *• • *• c *■ to false for each a,- and set to "true" at step El 9 as soon as 

This algorithm for resolution of the optimisation function " * . 7~ t , . F . , ... t . 

. °~ 4 e ii 11*- * ciA c u ui i the minimum complexity technique associated with the 

comprises first of all ^a calculation step E10 for each block ^ fa tf m * boolea ^ variable ^ ^ then the 

a ( - of digital data and for each coding technique m, for a codi techni can ^ modified ^ the foUowin tech . 

constituent consumed computational resource c by means of 25 nique ^ at step E20, incrementing by one unit the 

the coding technique expressed in calculation time. Mtx { of p^^g through the sorted list. The optimisation 

Examples of estimation of the constituent value of the algorithm stops when the available computational resource 

consumed computational resource were described previ- Ca is consumed. This condition is satisfied by a test E17 

ously for four acceptable coding techniques for the set E. which makes it possible, before the configuration modifica- 

It is of course assumed that the problem admits of a 30 tion step E18, to verify whether the current complexity value 

solution, that is to say that C is l ess tn an the allocated value C a . When this allocated 

value is achieved, the current coding configuration is then 

N the chosen configuration. 

""WM 2 ^"VfaD s c °- ' l can *> e remarked that the actual coding of the blocks a f 

i=1 35 can take place only once optimisation has been achieved. 

Returning to FIG. 1, this optimum coding configuration, 

, , , which associates a coding technique with each block of data 

It wiU also be assumed here that the elementary distortion tQ be ressed ^ meD ^ m a conve ntional fashion in 

values d can be estimated a prion, for example by means of ft ession st E4 ada ted t0 ^ the di ital ^ Y m 

a rate/distortion model linking an observed or measured 4Q a ressed data file p 

value (for example the energy of the block to be coded) to ln ^ ^ { embodimentj it was ^ it was 

we is r on. possible to estimate the values of constituent distortion 

A step E12 of estimating the distortions d^ajm,]) for quantities d^^m,]). However, as remarked previously, 

i=l, . . . ,N and . . . ,K is thus implemented. ^ is not a i wa ys possible. 

In a sorting step E13 consideration is given to the list 45 A description will now be given, with reference to FIGS, 

sorted by decreasing values of the values d(a,-,ajmy]). Let 3 and 4 of a second embodiment in which these constituent 

these values sorted by decreasing order be dXa l( ^,a t(i Jmy (0 ]) quantities must actually be calculated on the data after 

with 1=1, . . . ,NxK. coding, that is to say the required consumption of a com- 

Because of the upper bound distortion measurement, each putational resource associated with each technique, 

value of the sorted list represents an acceptable value of the 50 The steps of calculating the elementary complexities E21 

total distortion. and determining E22 the minimum complexity configura- 

It is then necessary to find a coding configuration asso- tion { m c^aJ} are identical to the previously described 

ciated with a distortion d^ i( ^ i( Jm Kf J) with the highest calculation E10 and determmation Ell steps, 

rank I, in the acceptable cSmplexSy domain. A Next > " a calculation step E23 the resulting constituent 

_ , r * .. c . f 55 distortion d(a.-,aJm Cmi>1 [a,]j) for each block a, with 

One solution is to start from the coding configuration of j ^ ^ calculated 

minimum complexity and I to sequentially modify the pairs ^ a calculaaon steJ'lSM makes it possible, as at the 

m/a,] so as to reduce the distortion until the allocated ^ dcscrib ed initialisation step E14, to calculate the 

complexity resource Ca is completely consumed. ^ Qf ^ computational ^pjexity C obtained for 

Thus a determmation step Ell makes it possible to ^ me minimum-complexity coding configuration, 

determine this minimum complexity coding configuration, j^e initial distortions are stored at the storage step E25 

that is to say the configuration consisting of the set {m^.^ tQe mdex Q f tDe and the coding parameters 

[a,]} where m Cm j;aJ=aTg min^.j ^c^faj). associated with the technique) in a list sorted by decreasing 

An initialisation step E14 is then implemented: the initial values of distortions 
coding configuration consisting of the set {m^^a,]} with 65 dXa /(0 ,a (W ^^ with m /(0 [a f 
i-1, . . . ,N, the value of the consumed computational (o] s m Cm Ja l( ^J in the initial state. The algorithm then pro- 
resource C with this coding configuration is initialised by ceeds by testing, for the maximum- 
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distortion block situated at the top of the list, the other 

coding techniques which have not yet been tested; if a lesser p^p 

distortion is obtained, then the coding configuration is 4 4 
updated by modifying the index of the method for the block 

under consideration (and the associated coding parameters) s and so on as far as a predetermined minimum block size, 

and then the ordering of the list is updated by moving the Th e information representing the spatial partitioning must 

block from the top of the stack to the rank corresponding to then be transmitted with the coding data (choice of the 

the new value of the distortion. It is a case in fact of an technique and associated parameters) for each block of the 

algorithm for managing a stack of fixed size with priority to partitioning. This information can take the form of a new 

the maximum-distortion element. The processing of the 10 coding technique which refers to the partitioning of the 

stack E26 is carried out as long as the current complexity C block into four sub-blocks which is to be processed recur- 

remains less than the available computational resource C„. sively. 

This processing E26 is detailed in FIG. 4. In practice, rather than inserting a new element in the list 

Step E2601 consists of sorting the list of elements formed ° f '^hniques, it ^preferred to code the division information 

at the previous step E25 by decreasing distortion values d,. 15 (or structural ^formation) separately. Tte code associated 

The algorithm then operates on the first element in the list of ^ each of u th ^ bl « :ks u , lhe 1 D co ° tams a supplementary bit 

index 1=1 with maximum current distortion d,. The first gating whether the block under considerate has been 

coding technique of index k(l) is then tested at step E2603 divided or coded just as it is. 

other than the minimum-complexity technique (test of step u description will be given, with reference to FIG. 5, of 

E2602). The resulting distortion dta^A.Jm^ J) is calcu- 20 variant of the optimisation dgonthm described previ- 

lated and the consumed computational resource C is ^ wlh refere , nce ,0 / ,G ' 4 - 10 wmch lhe elementary 

updated. If the allocated resource C„ is not all consumed distortions are calculated. t 

(testofste P E2604)andiftheresultingdistortionislessthan The first steps E21 to L25 described with reference to 

the current distortion d, (test of step E260«), then the ™£ 3 are unchanged, only the step of processing the list 

technique and the current distortion are updated at step 25 E26" being modified as described below. 

E2607. The list is then updated in the sense of sorting by The processing steps E2601 to E2609 are also identical to 

decreasing distortion value at step E2601. ^ described previously. 

t , « , , , , , • , 1 • . On the other hand, at the end of the test step £2609, where 

It should be noted that at this level, it suffices to move the M me , able ^ techniques have been tested (i.e. 

finU element of the tal which has jus. ^een modified. If the x k(1)>R) i( fc tested whemer me size rf ^ block ^ ^ 

method under consideration of index k(l) affords no saving minimum size 5 lhe dtree pest st m6ny 

m distortion (negative result of test E2606), the index k(l)+l , Q ^ case ^ cumnt eooB ^ ntioa ^ accepted for the 

is incremented and the algorithm is resumed at step E2602 block Md me elemem 

is extracted from the list at step E2612 

if there actually reman, techniques which have not yet been since ^ WQuld be simated ^ at the t of me ^ 

toted that is to say as long as k(l) is less than K (test of step 3J and finaUy ^ E2m ^ next returned tQ direcUy since , he 

order of the data has not been changed. 

Where all the acceptable techniques have been tested (i.e. Otherwise, when the size of the block is not yet the 

k(l)>K), the current configuration for the block is accepted. minimum size allowed, lhe block is partitioned into four 

In order to continue the algorithm, it is then necessary to sub-blocks in a partitioning step E2613. 

extract the element from the list at the extraction step E2610 40 for each of these sub-blocks, the minimum-complexity 

since the latter would be permanently situated at the top of technique is applied and the resulting distortion is 

me lis 1 - calculated, updating the consumed complexity (that is to say 

The previously described step E2602 is then returned to the processing steps E21 to E24 are applied to each of these 

directly since the order of the list has not been changed. The sub-blocks). 

algorithm stops at step E2605 when the consumed resource 45 The four new blocks are then inserted in the list, which is 

C reaches the allocated resource C a (test of step E2604). once again sorted at step E2601. 

In this example embodiment, the computational resource I* should be noted that the steps of inserting in the list and 

consumed by the algorithm itself has not been considered. It of sorting can be effected directly in a single step with a 

could notably be considered that the sorting step E2601 technique of sorting by insertion of an element one after the 

consumes the computational resource in a not insignificant 50 other. 

fashion. In this case, the value of C must be updated in a As before, the optimisation algorithm stops at step E2605 

suitable manner within step E2601. when the consumed resource C attains the allocated resource 

A description will now be given, with reference to FIG. 5, °" .... , 

of another embodiment of the invention in which step El of " * hould be no f ed that ' ln , thcse sccond and tmrd 

partitioning into blocks is effected by an adaptive partition- 55 embodiments, described with reference to FIGS. 3 to 6, at 

ing under the constraint of a given computational resource. ^ e end ^ ere 15 "* °P ,imisatI0n of aU necessary 

... , . .. ... , for the effecting of the actual coding of the digital image. 

A spatial partitioning of the video signal into a quadtree Adeyice fof cssion b blocks ad ted £ 

is considered here by way of non-hmitaUve example. ^ iaveQtion fc mustrated by way of example m fi Q 6 

It is in fact known, in digital image processing, to adapt ^ j n m is example, the compression device is integrated into 

the coding to the spatial content of the image. For this, it is a computer 10, comprising a microprocessor 100, a read 

sometimes beneficial to enable the partitioning to adapt by on i y memory 102 (ROM) and a random access memory 103 

allowing blocks of variable size in the partitioning. (RAM). 

One possible means is to adopt a structured partitioning This compression device comprises coding configuration 

into a quadtree. In this structure, a given block with a size 65 means 100, 102, 103 adapted to associate, with each block 

pxp of an additional "root" partitioning can be divided into a,- of digital data, a coding technique m ; . chosen from 

four sub-blocks of size amongst a set E of acceptable coding techniques as a 
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function of a criterion. This set E of acceptable coding only memory 102. The same applies to the parameters for 

techniques was described above with reference to FIG. 1. the coding techniques used by the program. 

According to the invention, the choice criterion is a As a second variant, me program can be received in order 

ftinction of optimisation of the rate or distortion characteris- to be stored as described previously by means of the 

ing the coding configuration under the constraint of a given 5 communication network 113. 

computational resource C fl . ^ computer 10 also has a screen 104 for displaying the 

The different optimisation functions which can be used information to be compressed or for example for serving as 

were cited above with reference to the compression method aD \ Dterface Wllh "operator, who will be able to param- 

according to the invention. ^P* lhe compression mode and parameters (the number 
. . & . c - ij -uj« and nature of the coding techniques employed) by means of 

As is clear from a reading of the previously described 10 ^ ^ m qt J* ^ ^ ^ ' fo / lc) . 

method t^his compression device comprises calculation ^ umt 10Q (cpiJ) ^ exeaUe ^ 
means 100, 102, 103 for each block of digital data a, and for felatmg lQ the iinplemeiltalion of me invention. On power- 
each coding technique m y for a constituent consumed com- ^ up ^ me programs an d methods relating to the invention 
putational resource, prior choosing means 100, 102, 103 for stored m a non . vo latile memory, for example the read only 
a criterion amongst a function of optimisation of the rate or is me mory 102, are transferred into the random access memory 
distortion characterising the coding configuration under the 1Q3, which will then contain the executable code of the 
constraint of a given computational resource, a function of invention as well as the variables necessary for implement- 
optimisation of the rate characterising the coding configu- ing the invention. 

ration under the constraint of a given distortion and a It is also possible to improve the compression method 
function of optimisation of the distortion characterising the 20 according to the invention by adding new coding techniques 
coding configuration under the constraint of a given rate, and to the set E, transmitted either by the communication net- 
possibly means of partitioning 100, 102, 103 into blocks of work 113 or by means of a diskette 110. 
digital data representing physical quantities adapted to effect The communication bus 101 affords communication 
an adaptive partitioning into blocks under the constraint of between the different subelements of the computer 10 or 
a given computational resource. 25 unked t0 il - ^ representation of the bus 101 is not 

The read only memory 102 is adapted to store a program limitative and notably the microprocessor 100 is able to 

for compression by blocks of digital data, and the random communicate instructions to any sub-element directly or by 

access memory 103 comprises registers for storing variables means of ^°^ GT sub-element of the computer 10. 

modified during the running of the program. ^ entire compression device described above can also 

The read only memory 102 can store notably the set E of 30 be incorporated in a videophone system on a transmission 
acceptable coding techniques. The random access memory network, notably with a low transmission rate. 
103 comprises, non-limitatively, a register a for storing the ^ compression method according to the invention used 
blocks a,, a register b for storing the constituent computa- m this videophone system is particularly efficient since it 
tional resources c(mJaJ), a register c for storing the con- makes il P ossible to take mt0 account a time constraint in the 
sumed computational resource C, a register d for storing the 35 coding configuration used and thus satisfactorily to corn- 
estimated value of the distortion d(a, 4£m,]) and registers i, P rcss dl 6 ltal im ages in real time. 

j, 1 for storing respectively the current indices i, j, I. main advantage of the invention is to allow explicit 

The microprocessor 100 is also adapted to supply the management of the computational resource by the compres- 

value of a given computational resource C a at a given sion operation in order to make it possible to obtain the best 

instant 40 P oss ibl e compression, in the sense of a rate/distortion com- 

In other words, the operating system must be capable of P romise with a computational resource (i.e. in a 

effecting a reservation of the computational resource at a limited time). 

given instant for a given period (it is a case of the capacity advantage is to make it possible to configure the 

known as CPU scheduling) and to make visible this avail- compression system in accordance with different modes 

able computational resource. 45 corresponding to the different possible compression criteria 

This microprocessor 100 is integrated into the computer and in Particular to make it possible to compress in an 

10, which itself can be connected to different peripherals, for optimum fashion in the sense of the usual rate/distortion 

example a digital video camera 107 or a microphone 111, by criteria, 

means of an input/output card 106, or a scanner (not shown) Wnat ^ claimed is: 

or any other means of acquiring and storing digital images 50 A meth od of compression by blocks of digital data 

such as a digital printer or a digital photographic apparatus. representing physical quantities, comprising the steps of: 

This computer 10 has a communication interface 112 a coding configuration step in which there is associated, 

connected to a communication network 113 so as to be able with ea ch block of digital data, a coding technique 

to receive or transmit digital information to be compressed chosen from amongst a set of acceptable coding tech- 

or already compressed. 55 niques according to a criterion, said choice criterion 

The computer 10 also has means of storing compressed a function of optimization of the rate or distortion 
data, such as a hard disk 108, or is adapted to cooperate by characterizing the coding configuration under the con- 
means of a disk drive 109 with removable document storage slf aint of a given computational resource, and 
means, for example, diskettes 110. a calculation step for each block of digital data and for 

Naturally, the diskettes 110 can be replaced by any 60 each coding technique for a constituent consumed 

information carrier such as a CD-ROM or a memory card. computational resource by means of the coding tech- 

These fixed or removable storage means can also include nique expressed in calculation time, 

the code of the compression method according to the wherein the computational resource incorporates the cal- 

invention, which, once read by the microprocessor 100, will culation time for obtaining said constituent consumed 

be stored in the bard disk 108. 65 computational resource and the consumed computa - 

By way of variant, the program enabling the compression tional resource for resolution of the optimisation func- 

device to implement the invention can be stored in the read tion. 
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2. The compression method according to claim 1, wherein 12. The compression device according to claim 10, said 
said optimisation function is adapted to minimise a rate optimisation function is adapted to minimise a mean distor- 
associated with the coding configuration for a computational Q 0 n associated with the coding configuration for a compu- 
complexity less than a given calculative resource. tational complexity less than a given computational 

3. The compression method according to claim 1, wherein 5 rcsourcc 

said optimisation function is adapted to minimise a mean ^ J. ^ , . A m 

J. . , ... j- c .* r 13. The compression device according to claim 10, 

distortion associated with the coding configuration for a . 4 . . 4 . t ..... j. - - • 

computational complexity less than a given computational whereiD said optimisation function is adapted to minimise an 

resource upper bound distortion associated with the coding configu- 

4. The compression method according to claim 1, wherein 1Q ration for a computational complexity less than a given 
said optimisation function is adapted to minimise an upper computational resource. 

distortion bound associated with the coding configuration 14. The compression device according to claim 10, further 
for a computational complexity less than a given computa- comprising means for choosing a criterion amongst a func- 
tional resource. ^jon Q f optimisation of the rate or distortion characterising 

5. The compression method according to claim 1, further the comng configuration under the constraint of a given 
comprising a prior step of choosing a criterion amongst a " uUtional resource) a faction of optimisation of the 
function of optimisation of the rate or distortion characters- rate characterising me coding configuration under the con- 
ing the coding configuration under the constraint of a given q( a iyen md a fonclion of optimisation of 
computational resource, a function or optimisation of the ., . ° , . . . « *• j 
rate of the coding configuration under the constraint of a f dlstorUon characterising the coding configuration under 
given distortion and a function of optimisation of the dis- 20 ^e constraint of a given rate. 

tortion characterising the coding configuration under the 15. The compression device according to claim 10, 

constraint of a given rate. wherein said set of acceptable coding techniques comprises 

6. The compression method according to claim 1, wherein inter codin S techniques, including a predictive coding by 
said set of acceptable coding techniques comprises tech- movement compensation, a coding by time prediction or a 
niques of inter coding, including a predictive coding by 25 coding by multilinear prediction, and intra coding 
movement compensation, a coding by time prediction or a techniques, including a coding by spectral transformation or 
coding by multilinear prediction, and intra coding a coding by vector quantisation. 

techniques, including a coding by spectral transformation or 16. The compression device according to claim 10, further 

a coding by vector quantisation. comprising means of partitioning into blocks of digital data 

7. The compression method according to claim 1, further 3Q representing physical quantities adapted to effect an adaptive 
comprising a step of partitioning into blocks of digital data partitioning into blocks under the constraint of a given 
representing physical quantities in which the partitioning of computational resource. 

blocks is effected by means of an adaptive partitioning under yj compression device according to claim 10, further 

the constraint of a given computational resource. comprising means of partitioning into blocks of digital data 

8. The compression method according to claim 1, further representing a digital image. 

comprising a step of partitioning into blocks of digital data 18 -j^ compression device according to claim 10, further 

representing a digital image. comprising means of partitioning into blocks of digital data 

9. The compression method according to claim 1, further representing a digital video signal. 

comprising a step of partitioning into blocks of digital data 19 nc compression device according to claim 10, said 

representing a digital video signal. device ^ing incorporated in a microprocessor, a read only 

10. A device for compression by blocks of digital data mem ory adapted to store a program for compression by 
representing physical quantities, comprising: blocks of digital data> and a random access mem ory corn- 
coding configuration means adapted to associate, with prising registers for storing variables modified during the 

each block of digital data, a coding technique chosen running of said program. 

from amongst a set of acceptable coding techniques as ^ 20. The compression device according to claim 19, 

a function of a criterion, wherein said choice criterion wherein said microprocessor is adapted to supply the value 

is a function of optimisation of the rate or distortion 0 f a gj ve n computational resource at a given instant, 

characterising the coding configuration under the con- 21. A computer, comprising a compression device accord - 

straint of a given computational resource, and m g to claim 10. 

calculation means for each block of digital data and for 5Q 22. A digital image processing apparatus, comprising a 

each technique of coding a constituent consumed com- compression device according to claim 10. 

putational resource by said coding technique expressed 23. A digital photographic apparatus, comprising a com- 

in calculation time, pression device according to claim 10. 

wherein the computational resource incorporates the cal- 24. A digital camera, comprising a compression device 

culation time for obtaining said constituent consumed 55 according to claim 10. 

computational resource and the consumed computa- 25. A videophone system on a transmission network, 

tional resource for resolution of the optimisation func- comprising a compression device according to claim 10. 

tion. 26. A computer program product, readable by a computer, 

U. The compression device according to claim 10, comprising software code portions adapted to implement the 

wherein said optimisation function is adapted to minimise a ^ compression method according to claim 1 when it runs on 

rate associated with the coding configuration for a compu- the computer. 

tational complexity less than a given computational 

resource. ***** 
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